perm filename CHAP7[4,KMC]7 blob
sn#055997 filedate 1973-08-01 generic text, type T, neo UTF8
00100 EVALUATION
00200
00300 The primary aim in constructing this model was to explore,
00400 clarify, develop, test and improve a theory having explanatory value.
00500 To satisfy this aim, the model must meet norms of internal
00600 consistency (systemicity) and norms of external correspondence with
00700 observation (testability). A secondary aim would involve pragmatic
00800 norms of application. These aims are not unrelated but our primary
00900 one is more fundamental since useful applications require some degree
01000 of consistency and observational correspondence.
01100 As emphasized in Chapter 2, a model in the form of an
01200 algorithm consists of a structure of functions or procedures whose
01300 inner workings are sufficient to reproduce the outward symbolic
01400 behavior under consideration. The theory embodied in the model is
01500 revealed in the set of statements which illuminate the connections
01600 betweeen input and output by describing how the structure reacts
01700 under various circumstances.
01800 What constitutes a satisfactory explanation has been treated
01900 in 2.1. The "fit" or correspondence with phenomena as indicated by
02000 measurements and empirical tests indicate the degree of faithfulness
02100 of the reproduction as described in Chapter 6.
02200 Decision procedures for a consensus acceptability of a model
02300 sometimes depend not so much on truth, an elusive state, as on
02400 whether a majority of the relevant expert community believes the
02500 theory or model to approximate truth to some unknown and unknowable
02600 degree and to be better than available plausible alternatives.
02700 Validation is ultimately a private experience of the individual.
02800 Empirical truth or falsity cannot be proven with certainty but their
02900 presence can be assayed by some sort of critical assesment and
03000 deliberation. We can forgive models for being only nearly true. A
03100 theory or model may bring cognitive or pragmatic comfort, not because
03200 it is TRUE but because it represents an improvement over its
03300 contending rivals.
03400 Cognitive comfort is a type of intellectual satisfaction.
03500 Pragmatic comfort accrues from applications to problems in order to
03600 make things work the way humans want them to work efficiently in
03700 practical contexts of technological action. For the pragmatist, a
03800 model is a means to an end; for the theoretician, an explanatory
03900 model is an end in itself. It is hoped that this paranoid model can
04000 contribute to understanding one of the mysteries of human conduct,
04100 the paranoid mode. There remains the enigma of the paranoid "streak"
04200 which renders whole nations susceptible to idelogical convictions
04300 regarding Elsewhereans as malevolent oppressors.
04400 It is a truism of methodology texbooks that an infinite
04500 number of theories or models can account for the same data of
04600 observation. Without questioning whether "infinite" means
04700 indefinitely large or just more than one, we must allow for rival
04800 explanations. For a rival to be a live and tenable option, it should
04900 be truly alternative (i.e., not just a version saying the same thing
05000 in a different way), have an appreciable prior probability, and be
05100 testable.
05200 Although I hold that faithful reproduction, fidelity as
05300 measured by indistinguishability, is a proper and major test for the
05400 adequacy of simulation models, it would be a bonus if our model could
05500 satisfy the function of making possible new knowledge through
05600 prediction. The term "prediction" has a spectrum of meanings ranging
05700 from forecasts, to prognoses to prophecies to precise
05800 point-predictions in time. To predict is to announce a fact without
05900 prior knowledge of it. However one needs knowledge of the kind of
06000 fact expected, the conditions which produce it and the circumstances
06100 under which it will occur. Accurate long-range predictions
06200 characterize the ideal of celestial mechanics. But even astronomers,
06300 with the advantage of isolated and repetitive systems, have their
06400 troubles; Halley's comet in the 18th century arrived four days later
06500 than predicted. With all our advanced knowledge of the 20th century,
06600 the pesky comet nevertheless arrived eight days later than predicted.
06700 Long-range predictions of individual human behavior are
06800 difficult because (1) sufficient knowledge of initial conditions may
06900 require that we know the whole past history of a person- something
07000 not yet achieved, (2) individuals do not remain isolated over the
07100 time stretch of the prediction; they interact with other individuals
07200 of an unknown nature (3) life is a fortuitous flux of chance
07300 intersections of independent causal chains. In one sense our
07400 paranoid model makes moment-to-moment predictions and asserts new
07500 counterfactuals about behavior in a psychiatric interview. That is,
07600 if an interviewer says X under conditions Y, then the model's
07700 response will be characterized by z1...zn. Counterfactual prediction
07800 means that on the basis of observed behavior we are willing,with an
07900 inductive risk, to assume the presence of unobserved behavior
08000 potentials in the model's repertoire of capabilities.
08100 Predicting new kinds of events or properties, instead of
08200 kinds we are already familiar with, would represent a genuine bonus,
08300 indicating the model is more than ad hoc and has excess content. It
08400 would give both clinicians and investigators something to look for.
08500 This novelty could arise in two ways. First, the model might
08600 demonstrate a property of the paranoid mode hitherto unobserved
08700 clinically. In principle this could come about because the I/O
08800 behavior of the model is a consequence of a large number of
08900 interacting hypotheses and assumptions chosen initially to explain
09000 frequently observed phenomena. When the elements of such a complex
09100 conjunction interact with highly variable inputs they generate
09200 consequences in addition to those they were designed to explain.
09300 Whether any of these consequences are significant or characteristic
09400 of the paranoid mode remains a subject for future study.
09500 It is also possible that a new property of paranoia may be
09600 discovered in the clinical interview, although perhaps everything
09700 that can be said about paranoid dialogues has been said. If a new
09800 property were found, a search for it might be conducted in the
09900 model's behavior. if successful, this again would add to the model's
10000 acceptability.
10100 A second novelty might arise in the behavior of the model in
10200 some new situation. Since it is designed to simulate communicative
10300 behavior in an interview situation, the `new' circumstance would have
10400 to involve some new type of linguistic interaction which the model is
10500 capable of responding to. From its behavior one might then predict
10600 how paranoid patients would behave under similar circumstances. The
10700 requisite empirical tests and measures would show the degree of
10800 correspondence between patient and model behaviors.
10900 This possibility is of importance in considering therapies
11000 for patients tangled in the quandaries of the paranoid mode. Since
11100 the model operates at a symbol processing level using natural
11200 language, it is at this level at which linguistic and semantic skills
11300 of clinicians can be applied. Language-based or semantic techniques
11400 do not seem very effective in the psychoses but they are useful in
11500 states of lesser severity. A wide range of new semantic techniques,
11600 including extremes, could be tried first on the model without
11700 subjecting patients to blind experimentation.
11800 While our group has used the model to explore a theory and to
11900 study psychiatric judgements, its potential use as a training device
12000 has not escaped our attention. Medical students and psychiatric
12100 residents need "disposable patients" to practice on without jeopardy.
12200 A version of the paranoid model can display the changes in its inner
12300 states during an interview. Whether the optimal goal of
12400 interviewing (gathering relevant information without upsetting the
12500 patient), has been achieved, thus can be estimated. A beginning
12600 interviewer can practice in private or with a supervisor present.
12700 Many interviewers have reported that the model has a definite effect
12800 on them. The student can get the feel of the paranoid mode long
12900 before he interviews an actual patient. The effect of various
13000 interviewing styles might be studied and compared.
13100
13200 It should be clear by now that this simulation of paranoia,
13300 while circumscribed in what it attempts to explain, covers a variety
13400 of facts. The explanation is local and restricted in that it accounts
13500 for only one type of symbol-processing mode. Past attempts at grand-
13600 scale explanations of all mental processes in all contexts have
13700 failed. We need to build one circumscribed and tested theory or
13800 model at a time so that the field can gradually move forward a step
13900 at a time, each step gaining consensus before attempting the next.